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ABSTRACT 

In order to evaluate the relative effectiveness of different active 
non-directional sonobuoys, a computer war game is developed. One 
submarine, employing one evasion tactic, is opposed by one helicopter, 
using five prosecution tactics. The tactic of the helicopter prior to the 
initial detection of the submarine is seento be critical, and this simu- 
lation aids in determining an optimum tactic. 

A cost-effectiveness model to use data from this simulation is 
developed. 

An example, using hypothetical but realistic data, is presented 
to illustrate methods of determining the cost-effectiveness of each 


sonobuoy type when used with its optimum tactic. 
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CHAPTER I 
INTRODUCTION 

The United States Navy currently uses many types of devices in the 
search for, and the localization and destruction of, enemy submarines. 

The sonobuoy, which is an air-dropped, expendable, sonar capable 
of relaying its findings to the aircraft, is one such device. A particular 
type is the active non-directional sonobuoy, which sends a pulse of 
sound into the water, and transmits the sound of that pulse and the 
sound of an echo pulse from a possible submarine to the aircraft via 
radio. From the difference in the two times, the range of the submarine 
from the sonobuoy can be determined. The locus of the submarine's’ 
possible positions is a hemisphere of that radius about the sonobuoy. 

In the Summer of 1966, while working with the Systems Analysis 
Staff of the Antisubmarine Warfare Systems Project Office, the author 
encountered the problem of developing a method of comparing the costs 
and effectiveness of several types of such active sonobuoys some of 
which were currently in use in the fleet and others of which were under 
consideration for future use. 

The precursor of this model was originally developed and used to 
solve the effectiveness part of the problem, and has been further devel- 
oped since then. 

I. THE PROBLEM 
A new anti submarine warfare (ASW) helicopter was being designed 


and to increase the effectiveness of the helicopter as an ASW fighting 


unit, the vehicle, its sensing equipment, and its kill device were being 
considered as a package. The kill device had been previously developed 
and was suitable for this helicopter. One sensing device had been incor- 
porated into the helicopter. It was a magnetic шиш detection (MAD) 
unit streamed behind the helicopter on a cable. When operated at a low 
altitude it can detect an anomoly in the earth's magnetic field caused by 
the presence of a steel submarine. MAD is a subsidiary sensing device, 
and is not adequate for localization when used by itself. 

The main device was to be an active sonobuoy system consisting of 
sonobuoys and equipment in the helicopter to process the data radioed 
from the sonobuoys. This system was under study and various compet- 
ing systems of sonobuoys were to be evaluated. A system consists of 
the sonobuoys and airborne receiving and processing equipment neces- 
sary for the effective use of the sonobuoys. 

IL REVIEW OF THE LITERATURE 

In determining whether or not a satisfactory model had been devel- 
oped by another agency the Defense Documentation Center was consulted 
since it is the repository of technical publications for the Defense 
Department. The Naval Postgraduate School library was searched 
because student theses frequently deal with similar problems. The 
Applied Physics Laboratory of Johns Hopkins University was consulted 
since many ASW models have been developed there. Also checked was 
Navy War Game Manual and its classified supplement. 

All searches indicated that no model had been developed to handle 


this problem. 





III, ORGANIZATION OF REMAINDER OF THESIS 

A description of the model, its purpose and assumptions will be pre- 
sented next, then input instructions for running the computer program 
and a description of the output data will follow. 

A cost-effectiveness example using hypothetical data will be followed 
by a summary and conclusions. 

The Bibliography is followed by an Appendix presenting flow charts, 
definitions of program names, the computer program in FORTRAN 63, a 
statistical examination of two critical aspects of the model, and the 


results of an analysis of the model's logic. 


CHAPTER II 
TACTICS SIMULATION 

Simulation was chosen because the problem was so complex that no 
mathematical model known to the author could handle it. 

One helicopter against one submarine was used, the assumption be- 
ing that this was the most likely combination to occur. 

From the analytic insight obtained by devising and playing a manual 
war game based on the author's tactical experience in ASW, it quickly 
became apparent that the helicopters tactics were so important as to 
overwhelm all other parameters except the range of the sonobuoy. 

It was decided to write a computer time-step simulation to evaluate 
the optimum tactic of the helicopter for each model of sonobuoy. Then 
the same program could be used to compare sonobuoy systems, using 
the optimum tactic for each. Here, tactic is defined as the laying of a 
pattern of sonobuoys onthe water. The initial tactic is to lay a pattern 
of sonobuoys whichis prescribed by doctrine for such an occasion. The 
pilot would continue it to completion unless a detection were obtained by 
one or more sonobuoys in the pattern. Subsequent tactics would depend 
upon the information received from the sonobuoys. 

I. PURPOSE OF THE MODEL 

The model has two functions. The first is to determine an optimum 
initial tactic to be used with each model of sonobuoy. The second is to 
determine the cost-effectiveness of each model of sonobuoy using the 


optimum initial tactic for that model. 
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II. DESCRIPTION OF SIMULATION 

The submarine's initial position is generated at random in a square 
of size determined by the user. Its course is also generated randomly. 
It pursues that course at its patrol speed until three conditions have been 
met: (1) the light-off time of at least one sonobuoy has occurred, (2) 
the present time, in seconds, is a multiple of thirty, and (3) the submar- 
ine is within twice the input range of the sonobuoy from one or more 
sonobuoys. At that time, it changes course to the reciprocal of the 
average bearing to the sonobuoys which satisfy the above requirements. 
At the time of the first detection of a sonobuoy by the submarine, the 
submarine doubles its speed and stays at that speed the remainder of the 
play (replication). 

The helicopter starts at its input position and flies at its input speed 
toward the first input sonobuoy coordinates. When it reaches that posi- 
tion it drops a sonobuoy and alters course toward the second input sono- 
buoy coordinates. The light-off time of the sonobuoy is 180 seconds after 
the time of the drop. The helicopter continues this sequence untiliit has 
dropped the input number of sonobuoys in the initial tactic or unfil at 
least one sonobuoy has achieved detection. Inthe first case, it then flies 
a square search of side .Z miles about the last sonobuoy coordinates. 

It has been determined by analysis that this square is the helicopter's 
optimum MAD entrapment tactic. Inthe second case it abandons the ` 
tactic, not to return to it again, and commences TAC], TAC2, or TAC3. 

The detections occur as follows. Every thirty seconds a check 1s 
made to see if the helicopter is within MAD range of the submarine. 
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If so, the replication ends in favor of the helicopter and a value of one 
is assigned as the outcome of that replication. If no detection occurs 
the game continues. Every thirty seconds all sonobuoys which have 
lighted off are checked to see if the submarine is within sonobuoy detec- 
tion range. The coordinates of the sonobuoys achieving detection and 
their distances from the submarine, up to a total of three sonobuoys, 
are recorded. 

In the following description the term "ring" will refer to a circle 
whose center is at a sonobuoy and whose radius is the detection range 
of the sonobuoy. 

If the helicopter gets information from only one sonobuoy, it checks 
to see if it, the helicopter, is inside the ring. If so, it proceeds out- 
ward from the sonobuoy to the ring, drops a sonobuoy, goes to the 
opposite arc via the center and drops another sonobuoy. It then com- 
mences a square search about the last sonobuoy. 

The phrase "drops a sonobuoy'' used anywhere except in TACA 
means that subroutine ECON is called and, if no sonobuoy is within one- 
half of its detection range from the helicopter at the position at which it 
is ready to drop, a sonobuoy is dropped there. If none is dropped the 
helicopter continues its current tactic. 

If the helicopter receives information from two sonobuoys simultan- 
eously, it flies to the nearest point of intersection of the two rings, drops 
a sonobuoy, proceeds to the second intersection, drops another sonobuoy, 


then flies a square search about the last. 
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If it receives information from three sonobuoys simultaneously it 
proceeds to the point of mutual intersection of the three rings, drops a 
sonobuoy, and flies a square 20 about that position. 

While the above is happening, every thirty seconds the sonobuoys 
which have lighted off are being checked for information. If no sonobuoy 
is Ob ion the current tactic continues. If one, two, or at 
least three sonobuoys are achieving detection, the one, two, or three 
ring tactic, respectively, is used. No information from any previous 
tactic is used in this case. 

If the submarine input escape time occurs the play ends in favor of 
the submarine and a value of zero is assigned as the outcome of that 
replication. 

Il, ASSUMPTIONS MADE 

Of the many assumptions made in adapting a computer model to 
reality, the following major ones are listed. 

A. Helicopter 

1. Тһе single helicopter starts from its initial position with 
the crew knowing that there is a possible submarine within an 
area about datum which is an input for eachgame. 

2. The helicopter is crewed by reasoning persons whose goal 
is to achieve MAD detection as quickly and using as few sono- 
buoys as possible. 

3. The helicopter, at the end of each tactic during which no 


new information came in, flies a square search. Whenthis is 
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done inthe initial tactic and in the tactic which results from 
only one sonobuoy achieving detection (one-ring tactic), it is 
assumed to be waiting for information. This is equivalent to 
random MAD in a "real" helicopter. In the two-ring and three- 
ring tactics it is trying to entrap the submarine to achieve MAD 
detection. 

Submarine 

l. At the start of play the submarine is proceeding on a straight 
course toward an objective, submerged and at patrol speed, 
unaware that the search phase detection has been made. 

2. Upon first detecting an active sonobuoy, the submarine 
skipper realizes he is being prosecuted by an aircraft dropping 
active sonobuoys in his vicinity. He changes his short term 
objective to eluding the aircraft, believing that if he manages 
to escape detection for a short time he will be able to escape 
the aircraft and resume his original objective. He therefore 
doubles his speed and attempts to elude all sonobuoys by taking 
as his course the reciprocal of the average bearing to all sono- 
buoys which have commenced emitting sound (have "lighted off'') 
and which are within his detection range. Thereafter he com- 
putes his course anew each time new data comes in, but keeps 
his speed constant. 

Sonobuoy 

1. Тһе sonobuoy has a 'cooky cutter' probability distribution 


function. 
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2. It has a three minute light-off time. 

3. All survive impact with the water and achieve ranges which 
are predictable. 

MAD 

1, The MAD gear has a "cooky cutter" probability distribution 
function. 

2. The gear is unaffected by helicopter maneuvering. 

3. The gear achieves ranges which are predictable. 

Other Assumptions 

l. Both the helicopter and submarine make pinpoint and 
instantaneous turns. 

2. The water has constant and uniform properties. 

3. Both the helicopter and the submarine have limitations upon 
the speed with which they may receive, process, and act on 
new data. The game was written so that new data can be acted 
on every thirty seconds of play. 

4. Ranges from the helicopter to the submarine and from the 
sonobuoy transducer to the submarine are considered horizontal 
ranges, not slant ranges. This simplifying assumption approxi- 
mates the case of a helicopter at low altitude, and the sonobuoy 


transducer and submarine at the same shallow depth. 
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CHAPTER III 
INPUT INSTRUCTIONS 

The input to this program is relatively simple. A maximum of 214 
items is to be read in. One is the title of the data set, thirteen are 
various performance parameters and miscellaneous items, and there 
are up to 200 X and Y coordinates of sonobuoys. A maximum of 100 
sonobuoys is allowed for the total used in all tactics of a single replica- 
tion. 

Figure l presents the card number, width of fields in terms of 


columns, and a description of each field or group of fields. 


l6 


Card 


Columns 


1-12 


ΓΞ 


16-20 


21-25 


26-30 


31-35 


36-40 


41-51 


11-20 


21-30 


Format 


2A6 


F5.1 


E25. I 


КБ 


E Saal 


i> ul 


BS. | 


ІП 222! 


010 


110 


110 


110 


Description 


Any alpha-numeric character may be used 
to designate data set number. 


VH = the speed of the helicopter in knots. 


VSS = the patrol speed of the submarine in 
knots. 


BRING = one-half of the side of a square, 
centered on datum, in which the submarine 
must start. 


XHH = the helicopter's starting x coordinate 
in nautical miles from datum, where 
(x,y) = (0,0) is datum. 


YHH = the helicopter's starting y coordinate 
in nautical miles from datum. 


TMAX = the excape time of the submarine 
in hours. 


RMAD = the radius of the MAD gear in 
nautical miles. 


RSB = the radius of the sonobuoy detecting 
capability in nautical miles. 


IIR = the starting argument for the random 
number generator, in octal. 


NSB = the number of sonobuoys inthe initial 
tactic. 


NREP = the number of replications desired 
in one game. 


KTEST: If zero, no statistical testing of 
random numbers will occur; ‘ff any posi- 
tive integer is placed here, tésting will 
occur. 


FIGURE 1 


INPUT DATA DESCRIPTION 
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Card Columns 


3 31-40 
+ 1-5 
+ 6-10 
4 11-80 
5-12 1-80 


Format 


110 


F 5."1 


Bibl 


ТКБ] 


SF: 5.21 


Description 


NRAN = the number of random numbers to 
be tested. 


A(z) = the x coordinate at which the first 
sonobuoy in the initial tactic will be 
dropped, in nautical miles from datum. 


Β(ὁ) = the y coor dinate of the first sono- 
buoy. 


x and y coordinates of sonobuoys two through 
eight. 


As above for sonobuoys nine through sixteen 
etc., to a total of 100 sets of (x, y) coordin- 
ates if desired. The number of (x,y) 
coordinate sets must agree with NSB on 
card 3. 


FIGURE 1 (CONTINUED) 
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СНАРТЕК ТУ 
OUTPUT DESCRIPTION 

There are three main and one supplementary outputs from this 
program. 

A read-out of the input parameters, as explained in Figure l, is 
illustrated in Figure 2(a). This is printed before the first replication 
starts. 

At the end of each replication four lines are printed. The first is 
“outcome of this replication" and a 1. 00 signifies a helicopter win, 


while a .00 signifies a submarine win. The other three are "number of 


sonobuoys used," "game hours to completion," and "number of this 
replication." These are illustrated in Figure 2(b). 

At the end of the entire game four more lines are printed; "average 
probability of detection," 'average number of sonobuoys used," "average 


game hours to completion," and "number of replications in the game". 
Figure 2(c) illustrates these lines. 

If the random numbers generated are examined, a listing of signifi- 
cant statistical information is made. The lists are "interval", "number 
in this interval", "mean", "sample mean'"', and "sample variance". 


These are shown in Figure 3 for the value IIR - 47532352. 
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ТАСТІС5 10 


120.0 6.0 4.0 0-20.0 1.0 ши. 0 47532352 
5 Ї 1 1555 
0-4.0 4.0 0 0 4.0 -4.0 0 0 
(a) 
OUTCOME OF THIS REPLICATION = 1.00 
NUMBER OF SONOBUOYS USED - 3 
GAME HOURS TO COMPLETION = ү 


| 
= 


NUMBER OF THIS REPLICATION 
(b) 


AVERAGE PROBABILITY OF DETECTION .18 

AVERAGE NUMBER OF SONOBUOYS USED 14.27 

AVERAGE GAME HOURS TO COMPLETION = “5 

NUMBER OF REPLICATIONS IN GAME 211 
(с) 


ЕІСОКЕ 2 


MAIN TYPES OF OUTPUT FROM PROGRAM: 
(а) INPUT;DATA; “(by DATA FROM ONE 
REPLICATION AND; (c) AVERAGE DATA 
FOR GAME 
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CHAPTER- V 
COST-EFFECTIVENESS EXAMPLE 


This simulation model can be used to determine an optimum initial 
tactic for use with a given model sonobuoy system. Another use is to de- 
termine the cost-effectiveness of different active non-directional sonobuoy 
systems by first finding the optimum initial tactic for each,then compar- 
ing the outputs 'average probability of detection''and''average number of 
sonobuoys used" together with cost information in a cost-effectiveness 
model to aid in deciding among the competing sonobuoy systems. 

All sonobuoys and their performance data, all output data, and all 


costs are hypothetical but realistic. 
I THE ASSUMED PROBLEM 


One active sonobuoy, the SQS-AA, is in current use inthe fleet. A 
new helicopter is being developed and the main sensing device for it 
could be one of two sonobuoys, the SQS-XX and the SQS-YY, currently 
inthe research phase. Only theoretical performance data is available 
for thellätter two, while for the former both theoretical performance, 
developed in the research phase, and observed performance data, 
recorded in use, are available. 

For the SQS-AA two cost studies are available: The initial study for 
the proposed new sonobuoy SQS-AA, done in 1957; a follow up study on 
the sonobuoy after it had been in the fleet one year, done in 1962. 

Only one cost study is available for each of the SQS-XX and SQS-YY 


sonobuoys; the initial studies, done in 1967. 
II RESULT DESIRED 
The solution to the problem will aid in determining which of the 


proposed new sonobuoys, if either,should enter into the development phase. 
22 





III USE OF SIMULATION MODEL 

The theoretical performance data for the SOS-AA has been used 
because the methods used to determine it correspond to the methods 
used to determine performance data for the SQS-XX and SQS-YY. 

The following scenario was selected. An тг submarine is 
detected by a shore unit and is determined to be within an area approxi- 
mated by a square of certain input dimensions. That жаа Ж а | 
convoy which has a destroyer based helicopter in the air to nn ава 


га 


“pouncer' aircraft. The НР е is vectored to - area and starts a 
localization process as described in chapter II, using tactics eh € 
systematically varied in a series of games. 

First one sonobuoy, the SQS-AA, is evaluated. Its performance 
data is put into the program together with a likely initial tactic which, 
as previously, stated, is a set of sonobuoy coordinates. The s input 
parameters are introduced now and will remain the same for all replica- 
tions of all games of the series. 

The first replication commences and the computer generates the 
submarine starting position within the square, and its course at random. 
Then the computer ''moves'' the helicopter and submarine until either 
"wins''a play. That terminates one replication of one game. For the 
next replication only the submarine's starting coordinates and course | 
are different. After a preset, input, number of replications, various 


important data is averaged and presented on the output sheet. Then the 


next set of input data is introduced to start a new game. This might 
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differ from the first set, for example, only in the radius of the pattern 
of sonobuoys in the initial tactic. 

This process is continued until all sonobuoys, used with all tactics 
likely to bring success to the helicopter, have been investigated. The 
best tactic for each is determined by graphing (average) probability of 
detection against any other significant parameter desired. For example, 
in figure 4 the radius of the sonobuoy pattern about datum was chosen. 
Figure 4(a) shows those two tactics plotted for all tactics which utilized 
the SOS-AA against conventional submarines of six knots patrol speed 
and twelve knot ''escape'' speed. Figure 4(b) shows the same for nuclear 
submarines of fifteen knot patrol speed and thirty knot escape speed. 

Figures 5 and 6 show the same type of graphs for the SQS-XX and 
SQS-YY respectively. The circular pattern of sonobuoys yields the 
highest probability of detection of the three types of tactics considered. 
Since the maximum ordinate on the graph falls at significantly different 
radii for conventional and nuclear submarines, the study would indicate 
different tactics against the two types of submarines. Both would 
employ the circular pattern but at different radii. Consequently, in the 
cost-effectiveness model to follow, the probability of detection for con- 
ventional and nuclear submarines will be deal with separately. Note: 
These graphs are hypothetical but are similar to classified production 
runs made with this model. 

This ends the effectiveness portion of the model and could be a 


separate tactics study of itself. However the optimum tactic, 
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probability of detection, and average number of sonobuoys used provide 
data for a cost-effectiveness study. 
IV COST-EFFECTIVENESS MODEL 

The initial cost studies on all three sonobuoys were selected for 
comparison purposes. Each study employs the ten year system cost 
technique. Build-up costs are negligible, since the forces which are 
to operate the equipment are already operating other sensing equip- 
ment which would be supplanted by the new sonobuoy systems. 

The ten year figure is arrived at by estimating that the sensor 
would be replaced entirely by another within ten years. 

The cost of the aircraft to carry the sonobuoy is ignored since the 
aircraft cost is added in at a higher level of analysis. Note that the 
Original aircraft which carried the SQS-AA was fixed wing while the 
type envisioned for the SQS-XX or SQS-YY is rotary winged. However. 
this model works equally well for fixed wing and rotary wing aircraft, 
the only difference being in the input speeds of the two types. 


The cost-effectiveness model and the terms used in it are as 


follows. 
111 i : : ‚th 
Pii - Probability of detection of a conventional submarine by i— 
sonobuoy type. 
P, - Probability of detection of a nuclear submarine by the th 


sonobuoy type. 
1251 refers to the SOS-AA 
i= 2 refers to the SQS-XX 


i= 3 refers to the SOS-YY 
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li 


са 


That fraction of the enemy's subsurface fleet devoted to conven- 
tional submarines in the 1970 decade. 

That fraction of the enemy's subsurface fleet devoted to nuclear 
submarines in the 1970 decade. 


(A, +A, = 1) 


2 
.th ; | 
The number of sonobuoys of the i— type used by the helicopter 
in its optimum tactic against conventional submarines. 
.th в. и 
The number of sonobuoys of the ¡— type used by the helicopter 
in its optimum tactic against nuclear submarines. 
` .th ; 
Cost per unit of the i— sonobuoy type as tabulated in column (8) 
of figure 7. 
.th 
Cost per unit of effectiveness of the i— sonobuoy type where 


í 


effectiveness is defined later in this section. 


с ΤΩ 4 
АР + АР A 


l1 n Zu 
LESS | 


V RESULTS OF EXAMPLE PROBLEM 


The breakdown of the costs for each model is shown in Figure 7 


where all numbers represent millions of dollars. Column (1), Research 


and Development, is self explanatory. Column (2), Initial Investment, 


represents the cost of tooling up and producing the estimated number of 


sonobuoys needed for ten years use, listed in column (7). Annual 


Operations, Column (3), is the average cost of storing and maintaining 


the dwindling supply of sonobuoys for one year, while column (4) repre- 


sents those costs for the ten year study period. Column (5) is the sum 
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(3) 


Annual 
Operations 


(4) 


Annual 
Operations 
Times Ten 


(2) 


Initial 
Investment 


(1) 


Research and 
Development 












Type 








505-АА 







505-ХХ 







505-ҮҮ 






(5) (6) (7) (8) 


Cost of Ten Cost in 1967| Number of Cost per 
Year System Dollars Sonobuoys Sonobuoy 
to be Pro- 
duced and 
Used. 





FIGURE 7 


COST OF THREE SONOBUOY TYPES 
(IN MILLIONS OF DOLLARS) 
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of columns (1), (2), and (4). It represents Ше ten year system cost in 
1957 dollars for the SOS-AA, and 1967 dollars for the SOS-XX and 
SQS-YY. In column (6) all costs are in 1967 dollars, where the annual 
inflation between 1957 and 1967 was determined to be 3%. Column (8) is 
the ratio of the entries in column (6) to the entries in column (7), and 
represents the cost of one sonobuoy for each of the three models. 

Figure 8 tabulates the numbers needed for the cost-effectiveness 
model presented in section IV of this chapter, Columns (1), (2), and (3) 
are taken from Figures 4, 5, and 6, and represent the Probability of 
Detection for nuclear and conventional submarines when the optimum 
tactics are used. 

In the decade 1970-1980, during which this system would Бе: 
employed, it is estimated that the enemy will have a mix of six сона Н 
tional submarines for every four nuclear. So A1 = отапа А, = ,4, 
Column (3) then, is the weighted mean of the items in columns (1) and 
(2). Columns (4) and (5) are the Average Number of Sonobuoys needed | 
for the tactic chosen, and column (6) shows the weighted mean of the 
numbers in the previous two columns. 

In column (7) the SOS-AA weighted mean probability of detection 
from column (3) is defined to be one unit of effectiveness and the effec- 
tiveness of the other two sonobuoys are computed in relation to it by 
dividing the entries in column (3) by . 074 to obtain column (7). In 
column (8), the ratios of the respective entries in columns (6) and (7) 


are listed, and represent the number of sonobuoys needed for one unit 


of effectiveness. 


3] 





FIGURE 8 


DATA FOR THE COST-EFFECTIVENESS MODEL 
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Column (9) lists the cost per unit of each type of sonobuoy as listed 
in column (8) of Figure 7. Column (10) is the product of the items in 
columns (8) and (9) and is the desired result. 

Using the criteria "Minimize Cost Per Unit Effectiveness", the 
SQS-YY would emerge as the 'best buy" despite its higher cost. This is 
in consonance with intuition because its range of ση -- input to the 
program was approximately four times that of the SQS-AA, x twice 


that of the SOS- XX. 
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СНАРТЕК УІ 
SUMMARY AND CONCLUSIONS 
I SUMMARY 

The problem was to find a means of comparing active sonobuoys of 
different performance and cost, and find a way to determine the relative 
cost-effectiveness of each type. From playing manual war games in 
which one helicopter was pitted against one submarine, it became 
apparent that the initial tactics employed by the helicopter were of para- 
mount importance in determining the effectiveness of each type sonobuoy, 
and yet the ''optimal" tactic for each was not known, 

A computer war game utilizing Monte Carlo technique was written 
when it was discovered that there was no model available in the litera- 
ture to test tactics for active sonobuoys. 

The model is documented in chapters II through IV, and is illustrat- 
ed by means of a complete cost-effectiveness example in chapter V. 

II CONCLUSIONS 

The computer war game developed is capable of doing two main 
tasks. 

It will evaluate the tactics of any aircraft using active sonobuoys 
SO as to arrive at one or more useful tactics for each type sonobuoy 
studied. 

Once the optimum tactic is decided upon, the numbers of sonobuoys 
used for each type may be used, together with cost information, to 


compare the sonobuoy types for cost-effectiveness. 
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The model has been thoroughly analysed by the statistical and 
geometrical methods presented in the Appendices. In addition ten hours 
of production runs yielded preliminary data which approximately agreed 
with the manual war games and coincided both with intuition and experi- 
ence. That data is classified secret and has not been included in this 


unclassified report, which concentrates on the underlying technique. 
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APPENDIX A 


GuNHAAL FLOW CHARTS 


ENDk—— N (INPUT CARDS) 






READ А.) «RITE INPUTS WET. RESULTS 














GENBNATE SUBM .R INE 
COORDINATES AND COURSE 















MAD 
SUBMARINE 





HELICO+TER .«ІТнім 
RANGE Or 


ЕКО OF GAME 
HELICOPTE: WINS 







ADVANCE TIME ONE SECOND 














END OF GAME 
ры M ee 3 d == E 
GAME TIME 01 SUBMARINE INS 





SONOBUGOY DATA 
COLLEC, 10N TIME 


CALL 
HDET 


HELO 
PEST 


CALL ў 
ТАСМ 
CALL SUBMARINE ACHIEVED 


TACM FIRST DETECTION 


























ACHIEVED 
DETZCT LION 


1,2,3, S:NOBUOYS 
ACHIEVED DETECTION 


CALL CALL CALL 
ТАС1 TAC2 TAC 





FIGURE 9 


MAIN PROGRAM 


SÅ 






Ν 
CHECK EACH SONOBUOY 
WHICH HAS LIGHTED ος, | ALL CHECKED 


FOR SUB DETECTION 









DETECTIONS 


RESET DETECTION 
COUNTER TO NUMBER 
OF DETS. MADE ON 
LAST SUCESSFUL 
INTEROGATION OF 
SONOBLOYS 









ELIMINATE HELICOPTER 
TACA FROM FURTHER 
USE 













RECORD COORDINATES 
OF SONOBUOYS AND 
RANGE FROM SUBMARINE 










RETURN] 








THREE DETECTIONS 


ENABLE TAC1,TAC2, 
TAC3 TO BE USED 
AGAIN 






159 SECONDS 
SINCE TAC1 OR 
TAC2 CALLED 






FIGURE 10 


HBLICOPTER-SONOBUOY DETECTION. SUBROUTINE 












OFF FOR SUBMAKINE 
DETECTION 





ELIMINATE SUBMARINE 
TACM FROM FUSTHER 
USE 





ADD BEARING OF 
SUBMARINE TO 
TOTAL OF OTHER 
SONOBUOYS DETECTING 


N 
CHECK EACH SONOBUOY 
WHICH HAS LIGHTED 


ALL CIIECKED 
А 
DETECTIONS \ 
SET SUBMARINE 
COURSE TO 
RECIPROCAL OF 
AVERAGE BEARING 
















FIGURE 11 


SUBMARINE DETECTION SUBROUTINE 
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ALL SONOBUOYS ALLOTTED CALL 
FOR TACA DROPPED SQSE 











ADVANCE HELO TO 
INPUT POSITION 
OF NEXT (QR FIRST) 
SONOBUOY TO BE 
DROPPED 








AT POSITION 
y 


DROP SONOBUOY AND 


COMPUTE LIGHT OFF 
TIME 





FIGURE 12 


HELICOPTER INITIAL TACTIC SUBROUTINE 
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> 


TACL COMPLETE CALL 


N 



















DETERMINE IF HELICOPTER 
IS INSIDE OR OUTSIDE 
RING 


ADVANCE HEL: COPTER 
TOWARD RING 


AT RING 


CALL 
ECON 


ADVANCE 
COUNTER 


RING 


RING CROSSED 





TWICE DECLARE 
ТАСІ 
Ν COMPLETE 







CAUSE HELICOPTER 
COURSE TO BE 
TOWARD OPPOSITE 
SIDE OF RING 


RETURN 


FIGURE 13 


HELICOPTER TACTIC ONE=RING SUBROUTINE 
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ВЕСТ 
TAGS 


CALL |. 


TAC2 COMPLETED SQSE 









MADE 


COMPUTE TWO 
INTERSECTIONS 
OF RINGS AND 


AND POINT TWO 





DESTINATION 
IS POINT ONE 


y/ TAC2 USED SINCE 
LAST DETECTION 


LABEL POINT ONE 





POINT ONE CLOSER ) 





DESTINATION 
IS POINT TWO 


ADVANCE HELICOPTER 
TOWARD DESTINATION 


AT DESTINATION 


7 


CHANGE DESTINATION 


TO OTHER POINT 


CALL 
ECON 








SECOND DESTI- RETURN 
NATION REACHED 

y | 
TAC2 COMPLETE 


FIGURE 14 


HELICOPTER TACTIC TWO-RING © 
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ВЕСІМ 
TAC3 


CALL 
TAC3 COMPLETE 





DETERMINE MUTUAL 
INTERSECTION OF 
THREE RINGS 










ADVANCE HELICOTTER 
AT INTERSECTION 


CALL 
ECON 


TAC3 COMPLETE RETURN 


FIGURE 15 


HELICOPTER TACTIC THREE=RING SUBROUTINE 
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2 


САГОСАТЕ ТІМЕ 
TO COMPLETE SIDE 
OF SQUARE 


HELICOPTER STARTS AT ZERO 
AND TAKES COURSES 
AS SHOWN 


ADVANCE HELICOPTER 
N 
TIME TO TURN 


y 
TURN LEFT AS RETURN 
— 





FIGURE 16 


HELICOPTER SQUARE SEARCH SUBROUTINE 









ADVANCE SUB ALONG 
INITIAL COURSE FROM 
INITIAL COORDINATES 






(a) 








ADVANCE SUB ALONG 
EVASTON COURSE 
CALCULATED IN SDET 







(Ы) 


FIGURE 17 
(a) SUBMARINE FIRST TACTIC SUBROUTINE 


(b) SUBMARINE SECOND TACTIC SUBROUTINE 
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CHECK EACH SONOBUOY 
WHICH HAS 
BEEN DROPPED 





WITHIN ONE-HALF 
DETECTION RANGE 
OF PROPOSED 

DROP POSITION 





ADVANCE COUNTER 
OF SONOBUOYS | 
WITHIN DETECTION | 
RANGE 








ALL SONOBUOYS CHECKED 


y 





ADVANCE SONOBUOY 








COUNTER, COMPUTE N / ONE OR MORE 
LIGHT OFF TIME, SONOBUOYS WITHIN 
RECORD SONOBUOY RANGE 
COORDINATES 
y 
RETURN 
FIGURE 48 


SONOBUOY ECONOMIZING SUBROUTINE 





SET COUNTERS 













GENERATE RANDOM 
NUMBERS, SORT INTO 
INTERVALS, COMPUTE 

SAMPLE MEAN 








GENERATE SAME 
RANDOM NUMBERS, 
SORT, COMPUTE SAMPLE 
VARIANCE, MEAN 
VARIANCE, AND 
INTERVALS. 


PRINT DATA 
RETURN 


FIGURE 19 


RANDOM NUMBE:? TEST SUBROUTINE 
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АА, ВВ 


А(1) 


АК 
ALFA 
AMAN (I) 
BE(I) 


B(I) 


BRING 


CUS 


ECON 


HDET 


IIR 


IR 
ЧА 
КСК 


КМЕАМ 


KSB 


шэн МИ Б. 
DICTIONARY OF PROGRAM NAMES 
No meaning attached; For reading in title of data set. 


Input X coordinate for (qas sonobuoy of helicopter's 
initial tactic. 


Floating point equivalent to counter K in subroutine TEST. 
Initial course of Submarine. 
th : ; 
Mean of the I— interval in Subroutine TEST 
| tha Р : 
Lower endpoint of F— interval in subroutine TEST. 


h 
Input Y coordinate for (ps sonobuoy of helicopter's 
initial tactic. 


Input value of one half the side of the square in which 
submarine is contained initially. 


Computes escape course of Submarine in Subroutine TACN. 
Subroutine which drops new sonobuoys in ТАС1, ТАС, 
and TAC3 only is there are not one or more sonobuoys 


within detection range. 


Subroutine which queries sonobuoys for detection of 
submarine, 


Input argument for random number subroutine. Entered 
in octal. 


Equivalent to IIR. 
Counter for submarine and helicopter data collection. 
Prevents KTLIT(I) from being calculated more than once. 


Tells if sample mean has been computed. Done on first 
pass through random numbers. 


The number of sonobuoys (plus one) which have been 
dropped at any given time. } €KSB = 101 
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KSBCK 


MEST 


KTIME 
ГЕТ (Т) 
КТМАХ 


LL 


MCK 


MS 


MT 


MTA 


MU 


MX 


NCK 


NN 
NP 
NR 


NRAN 


МКЕР 


Counter which prevents helicopter from dropping a sono- 
buoy if there are one or more within one-half of the 
detection range of the intended drop position. 


Input which determines whether or not subroutine TEST 
is called. 


Game time in seconds. O£KTIME<KTMAX 
th 

Light off time of (1-1)— sonobuoy. 

Fixed point equivalent of TMAX ` 3600. 


Prevents TAC] and TAC2 from being started over unless 
150 seconds have elapsed. 


Number of sonobuoys achieving detection at a given intero- 
gation time. 


Prevents helicopter from using TACA after a detection 
has occured. 


Determines what side of square search helicopter is on. 


Counter of seconds of helicopter advancement along a 
side of the square search. 


Number of seconds helicopter advances for one-half the 
side of the square search. 


Determines if TAC] has been completed. 


Records value of M at start of subroutine HDET and 
assigns its value to M again if no detections occur. 


Prevents TACM from being used after submarine first 
detects a sonobuoy. 


Determines secondary tactic within TACI. 
Distinguishes between two arms of ambiguity in TAC2. 
Counter for number of replications 


Input which determines how many random numbers are 
evaluated. 1355 is the most it is necessary to call. 


Maximum number of replications desired. 
Maximum needed is 271. 
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NS 

NSB 

NT 

PROB 
PSUM 

R 
RANDOM 
RANI 


КОЕТ 


КМАО 
RSB 
SDET 


SMEAN 


SQSE 


SUM 
SVAR (1) 
TACA 
TACI 
ТАС2 
ΤΑς 2 
ТАСМ 
ТАСК 


PESI 


Determines if TAC3 has been completed. 

Number of sonobuoys in a full TACA pattern. 

Tells helicopter what to do within TAC2. 

Number assigned when TMAX or MAD occurs. 
Numerator of average probability of detection fraction. 
Random number in FORTRAN IV 

FORTRAN 63 equivalent of R. 

Random number subroutine. 


Radius in nautical miles from each sonobuoy achieving 
detection to the submarines. 


''Cooky Cutter'' range of MAD gear in nautical miles. 
"Cooky Cutter'' range of sonobuoys, in nautical miles. 
Submarine's subroutine for detection of sonobuoys. 


Sample mean of an interval of width one-tenth in sub- 
routine TEST. 


Subroutine which moves helicopter in a square pattern to 
attempt MAD detection. 


Numerator of average course fraction. 

Sample variance of each interval in subroutine TEST. 
Helicopter's imitialltach 

Helicopter's one-ring tactic. 

Helicopter's two-ring tactic. 

Helicopter's three-ring tactic. 

Submarine's initial tactic. 

Submarine's evasion tactic. 


Subroutine which tests random numbers for randomness. 


ЭМ 





ТМАХ 
ТРЕОВ 
U(E) 
VAR(K) 
VH 
vss 


XDET (M) 


XH 


ΠΠ 


XKSB 
XNR 


xP 


pep 


pap? 


XS 
XTIME 


YDET (M) 


YH 


Submarine!s escape time in hours. 

Average probability of detection of submarine by helicopter. 
| Ыы > : : 

Upper endpoint of I— interval in subroutine TEST. 

Term needed to compute sample variance. 

Helicopter airspeed in knots. 

Submarine patrol speed in knots. 


f th Р Е 
X coordinate of Mt— sonobuoy detecting submarine, in 
nautical miles. 


X coordinate of helicopter in nautical miles. 


X coordinate of helicopter initial position in nautical 
miles. 


Denominator of CUS. 

Р " th 
X coordinate id nautical miles of (I-1)— sonobuoy which 
has been dropped. Also serves as a counter in subroutine 
TEST. 
Floating point equivalent of KSB. 


Floating point equivalent of NR. 


X coordinate in nautical miles of one point of intersec- 
tion of two circles, (XBax Ploni P=XB2). 


X coordinate of one point of intersectionof two circles 
in TAC2 and TAC3. 


X coordinate in nautical miles of the other intersection. 
(See ХР!) 


X coordinate of submarine in nautical miles. 
Floating point equivalent of KTIME, 


Е th 
Y coordinate in nautical miles of M— sonobuoy detecting 
submarine. 


Y coordinate in nautical miles of helicopter. 


οἱ 


YHH 


Ү(1) 


YKSB 


ҮР 


αρ] 


Y E 


YS 


YTIME 


Y coordinate in nautical miles of helicopter's starting 
position. 


Y coordinate in nautical miles of ng sonobuoy which 
has been dropped. Also serves as a counter in subrou- 
tine TEST. 


Numerator of average number of sonobuoys used. 


Y.coordinate in nautical miles of one point of intersection 
pf two circles. (YP-YPlLl omm P-YPZ2)}. 


Y coordinate in nautical miles of one point of intersection 
of two circles in TAC2 and TAC3. 


Y coordinate in nautical miles of the other intersection. 
(See YP1). 


Y coordinate, in nautical miles, of submarine. 
Numerator of average time fraction. 


Term needed to compute sample variance in subroutine 
TEST. 


Note: This program was originally written in FORTRAN IV, then 


altered to FORTRAN 63. Severalterms, such as EQUIVALENCE (R, 


RANDOM), and FUNCTION SQRT, were inserted to avoid much rewrit- 


ing of complicated expressions. 
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APPENDIX D 
STATISTICAL EXAMINATION OF MODEL 

In order that the user of the model may decide on the degree of confi- 
dence to place in the model's results, two critical features are examined 
statistically. Those examinations are presented in this appendix. 

I RANDOM NUMBERS 

Five random numbers are generated in each replication. They 
control the area of the square the submarine is contained in at the start, 
and the initial course of the submarine. The random number generator 
is assumed to be uniform between zero and one but, as is well known, 
the numbers from a random generator are not random at all, but are 
instead a rigid sequence of numbers determined by the program which 
generated them and the intial argument specified by the user. The- 
user should examine those random numbers which his program uses, 
to determine if they are close enough to true randomness to meet the 
requirements of his problem. If they are not, one standard procedure 
to effect a change is to change the initial argument until a nearly ran- 
dom sequence of numbers has been obtained. That has been done for 
this model and the results and statistical methods follow. 

As will be explained in the subsequent section of this appendix, 271 
replications are the most runs necessary to achieve eighty one per cent 
confidence that the probabilities of detection of two games which differ 
by one-tenth are statistically different. 1355 random numbers are the 
most which will ever be needed, and sequences of that length have been 
examined. The input values of KTEST=1, NRAN= 1355, and 
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IIR=47532352 (octal field) were used and the results were as presented 
in Figure 3 of Chapter IV. 

Subroutine TEST called 1355 numbers, sorted each into 10 intervals 
of one-tenth width each (arbitrary) counted the numbers in each inter- 


val and computed their sample mean as (4): 
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where n is the number of random numbers which fell into a given inter- 
th . | 
val and Х, is the value of the 1: number in that interval. 
The same random numbers were generated again and this time the 


sample variance was computed as (4): 


a. — ΩΝ 
ЭЗЭЛНЭ 


where the symbols n, ын and X have the same meaning as before. 


Next the mean (5), 
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where a is the lower limit of the interval and b it's upper limit, was 


computed for each interval. The variancemas getérminedøby (5); 
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was then determined to be a constant in all intervals. 

The upper and lower limits were then computed and all the above 
information presented in the following order: Interval limits; Number 
of random numbers which fell into this interval; Mean; Sample mean; 
Variance; and Sample Variance. 

The numbers in Figure 3 are the result. Since the number in each 
interval is close to 135.5 and there is close agreement between the 
mean and sample mean, and the variance and sample variance, these 


70 





random numbers are regarded by the author as sufficient for the pur- 
poses of this model, hence the initial argument shown is recommended. 
IL PROBABILITY OE DETECTION 

The outcome of each replication is a one if MAD occurs and a zero 
if it does not. The only things which change from one replication to the 
next are the submarine's starting coordinates and course. These are 
determined by the random numbers which, we have seen, are reason- 
ably random. So the outcome of each replication, or ''experiment' may 
be considered belonging to two categories, called ''successes"! or 
"failures" and represent independently repeated, or ''Bernoulli trials" 
(5). 

The maximum likehood estimator for the mean of the Bernoulli 


distribution is (4) n 


A large enough sample (271) is present for the normal approximation to 
be accurate. A ninety per cent confidence that Ῥ is Within + "O05 of the 
"true" population mean is desired. The model for the large sample 
confidence interval of the normal approximation of the Bernoulli distri- 


bution is (4): P(90% of sample means will be between Pt. 05 and P-. 05) 
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So the most replications ever necessary is 271, and that only if the 


probability of detection is . 5. If the probabilities are different, the 


number of replications required for the same confidence interval is 


А 
less. For example, if P =.1, thenn 2 98. 


A 
The estimator P will fall within .05 of the "true" value of P 90% 


of the time. But we wish to know if a probability that differs by . 1 


TE 





from another represents a 'better'" tactic. In order to resolve the two 
points each of which is 90% certain, each must lie within + . 05 of it's 
true mean. So if the points are separated by .1 we may be (.90)(. 90) - 
100 = 81% confident that the two points are '"statistically different". 
Assuming the model does not bias one tactic over another, we may be 
81% certain that the tactic with the higher probability of detection is 


"better" than the other. The author sees no evidence of such bias. 
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AEPENDIX E 
ANALYSIS OF MODEL'S LOGIC 

A complete analysis of one replication is presented geometrically 
in Figure 20 and in the following text. The solid line in the Figure 
represents the helicopter's path and the broken line that of the sub- 
marine's. The arcs with numbers on them indicate the detection time 
from the sonobuoy in the center ofthe arc. Presented at the top of 
Figure 20 is a write out of the input to this game. This is a replication 
which the helicopter ''won'', and illustrates many of the model's 
features. 

Cards were inserted into the program to cause certain critical 
values to print out every one second of game time. These values 
represent the positions of the helicopter and submarine at all timess 
positions of the sonobuoys, the positions and ranges to the submarine 
of all sonobuoys up to a total of three achieving detection at any given 


time, and the current game time in seconds. 


TIME EVENT 

0 sec. Helicopter starts at (x, y)=(0,-20), (not shown). 
Submarine starts at (2.2, .2). 

478 Helicopter lays sonobuoy No. 1 at (0,-4.1). 

648 Helicopter lays sonobuoy No. 2 at (4.0, -. 1). 

658 Sonobuoy No. 1 lights off. 

660 Submarine detects sonobuoy No. 1, changes its-course 


to go away from it, and doubles its speed. 


818 Sonobuoy No. 3 is dropped. 
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EVENT 
Sonobuoy No. 2 lights off. 


Submarine detects sonobuoy Nos. l and 2 and alters course. 
Helicopter detects submarine on sonobuoy No. 2 and alters 
course as directed by TACI. 


Helicopter drops sonobuoy No. 4 on the ring of TACI, at 
(ООЗЕ ЈА 


150 seconds delay time has elapsed since first detection. 
Helicopter reverses course to restart TAC1. 


Submarine detects sonobuoy Nos. 1, 2, and 3 and alters 
course. 


Helicopter reaches ring of TAC1 but is prevented from 
dropping because sonobuoy No. 4 is nearby. Reverses 
course. 


Submarine detects sonobuoys No. 1, 2, 3, and 4 and alters 
course. Helicopter detects submarine on sonobuoys No. 2 
and 4 and alters course toward the nearest intersection of 
the two rings as in TAC2. 


Helicopter, at (2.0, .8) detects submarine, at (1.9, . 9), 
by MAD and replication ends in favor of the helicopter. 
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